Papers with structured attention mechanism
Evaluating Discourse in Structured Text Representations (P19-1)
Copied to clipboard
| Challenge: | Discourse structure is integral to understanding a text and is useful in many NLP tasks. |
| Approach: | They propose a structured attention mechanism for text classification that derives a tree over a text, akin to an RST discourse tree. |
| Outcome: | The proposed model improves performance on multiple discourse-relevant tasks and datasets and ablation studies show it does little to capture discourse structure. |
Recovering dropped pronouns in Chinese conversations via modeling their referents (N19-1)
Copied to clipboard
| Challenge: | Pronouns are often dropped in conversational genres as their referents can be easily understood from context. |
| Approach: | They propose an end-to-end neural network model to recover dropped pronouns in conversational data. |
| Outcome: | The proposed model improves on three different conversational genres. |
Structured Alignment Networks for Matching Sentences (D18-1)
Copied to clipboard
| Challenge: | Many tasks in natural language processing involve comparing two sentences to compute some notion of relevance, entailment, or similarity. |
| Approach: | They propose a model of structured alignments between sentences to compare two sentences by matching their latent structures. |
| Outcome: | The proposed model is differentiable and trained only on the matching objective. |
An Imitation Learning Approach to Unsupervised Parsing (P19-1)
Copied to clipboard
| Challenge: | Unsupervised parsing is a form of reinforcement learning that improves syntactic structures but lacks interpretability due to its lack of ad hoc heuristics. |
| Approach: | They propose an unsupervised approach that transfers syntactic knowledge to a Tree-LSTM model with discrete parsing actions. |
| Outcome: | The proposed model outperforms existing models on the All Natural Language Inference dataset and achieves a new state of the art in terms of parsing F-score. |